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I. 



INTRODUCTION 



A comparison of several sets of observations drawn from 
normally distributed populations can be performed by means 
of the statistical procedure known as the analysis of var- 
iance. The justification for the statistical procedure in 
the analysis of variance depends directly upon the applica- 
tion of Cochran's Theorem stated below. 

Cochran's Theorem Let X = (X^ ,'&2 , . . . ,X n ) be distributed 
as N n (0,I) and suppose 

n - k 

I *■ = I V*) 

i=l 1 i=l 1 

where is a quadratic form of rank n^^ , i=l,...,k. Then 
(X) , . . . ,Q^. (X) are mutually independent and Q (X) is dis- 
tributed with n^ degrees of freedom, i=l,...,k, if and only 
if 

k 

1 n i = n. 
i=l 1 

Cochran's Theorem formally relates (a) the degrees of 
2 

freedom of a x random variable, Q(X) , with the rank of its 
associated observed variate, Q(x) , when X is N n (0,I) and 
(b) the sum of the degrees of freedom of a set of x random 

variables with the dimension of the random vector X; the 

2 

independence among the x random variables is a consequence 
of this relationship [2]. 
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Hence, if a statistician is collecting a random sample 
from a normally distributed population and if the sum of 
squares of the observations from the random sample, x = 
(x^,.../X n ) , equals the sum of several quadratic forms in 
x, say Q 1 , . . . ,Q k , he must show that the sum of the ranks of 
these quadratic forms is equal to the number of total obser- 
vations before he can conclude independence of the Q^'s, 

2 

i=l,...,K, and assign x probability distributions to them. 

In the analysis of variance these quadratic forms, when 

divided by their ranks, represent independent estimates of 

2 

an unknown variance a associated with a random variable 

2 

vector Y which is N n (y,a I). The N (0,1) hypothesis of 
Cochran's Theorem becomes satisfied upon letting 

X = i(Y-y) . 

2 

Since the normalized quotient of independent x variables 
is an F-random variable, F-statistics , which are used to 
test hypothesis concerning y, can be formed from the ratio 
of the quadratic forms in x. 

In turn then, it can be seen that the application of 
Cochran's Theorem depends upon the determination of the ranks 
of the quadratic forms in x in the relation 

n 2 

l x i = Q-l (x) + Q 2 (x) + . . . + Q r (x) . 

i=l 

Cramer [1] gives a procedure for determining the rank 
of quadratic forms as follows: 
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2 2 

".... If Q may be written in the form Q = + ... + 

where the L. are linear functions of x.,...,x and if there 
are exactly m independent linear relations'*' between the L^ , 

then the rank of Q is k-m " 

Cramer calls this a proposition. 

Likewise, Hald [2] states a similar procedure as a def- 
inition . 

"The number of degrees of freedom for a set of variables , 

will be defined as follows: Let the k variables 

L^,...,L^ be linear functions of n stochastically independ- 
ent variables, x^,...,x , which are assumed to be normally 
distributed with parameters (0,1). If m independent lin- 
ear relations^" exist between the k variables, L^,...,L^, 
the number of degrees of freedom is k-m. The number of 
degrees of freedom for the sum of squares 

k „ 

Q = l L 2 . 
i=l 1 

is defined as the number of degrees of freedom for the k 

variables L. , . . . ,L, . " 

1 k 



Both Cramer and Hald point out that the m linear rela- 
tions between the L's are iinearly independent. Formally, 
a linear relation has the form 



c i L i + 



+ c k L k - 0 



where the c^ are constants and not all zero. When several 
linear relations of this form exist, they are called inde- 
pendent, if the corresponding vectors c = (c^,...,c^) are 
linearly independent. 
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Cramer's proposition is stated, but not proved. Hald, on 
the other hand, precludes the necessity of proving the same 
proposition by calling it a definition. In either exposition 
no detailed theoretical verification is made of the procedure 
for determining the rank of quadratic forms . It is the in- 
tent of this thesis to (1) state and prove basic theorems 
which can be used to determine the rank of quadratic forms 
in the way presented by Cramer and Hald and (2) illustrate 
the use of these theorems in the analysis of variance. 
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II. MATHEMATICAL BACKGROUND 



The theory which is to be developed concerning the rank 
of quadratic forms depends upon several mathematical results 
from matrix algebra [3,4]. This chapter outlines the perti- 
nent mathematical definitions and theorems that are necessary 
to develop this theory. 



A. MATRICES 

A matrix A has elements denoted by a. . where i refers to 
the row and j to the column. If A denotes the matrix, then 
A' denotes the transpose of A, and A , the inverse of A. 

The symbol |a| is used to denote the determinant of A. The 
identity matrix is denoted by I; and 0, the null matrix . 

The dimension of a matrix is the number of rows by the num- 
ber of its columns, e.g., nxm. A matrix A of dimension nxl 

2 

is called a column vector ; its transpose A' , a row vector . 
The rank of a matrix A is denoted by r(A) . Euclidian n-space 
is symbolized by E n> 

Given matrices A = (a. .) and B = (b. .) where the number 

ID " ID 

of columns of A equals the number of rows of B, the product 

th 

AB = C = (c^.) is defined as the matrix C with the pq 



2 

Column vectors will be indicated by round brackets, as 
x = (x^,...,x ); row vectors will be indicated by square 
brackets, as x = [x^,...,x n l. 
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n 



element equal to £ 

k=l 



a ,b, . 

pk kq 



A + B = C gives a . + b . = c. 

- ID ID ID 



provided A and B have the same dimension. If k is a scalar 

+* H 

and A a matrix, then kA means the matrix whose ij element 
is ka^j. A diagonal matrix D is a square matrix whose off- 
diagonal elements are all zero; D = (d^j) where d^^ = 0 if 
i ^ j. A matrix is called symmetric whenever A = A'. If C 
is an nxn matrix such that CC ' = I, then C is said to be an 
orthogonal matrix, and C' = C \ 

Theorem 2 . 1 r(AA') = r(A) = r(A'). 

3 

Theorem 2.2 Let A be nxn, symmetric and non-negative. 
Then there exists a non-singular matrix C such that C'AC = 
(d^ij) where d^{0,l}, i=l,...,n and the rank of A equals 
the - number of non-zero d. 's. 

l 

Theorem 2 ♦ 3 If A is an mxn matrix of rank r, and if B 
is an nxq matrix such that AB = 0 , then the rank of B cannot 
exceed n-r. 

Theorem 2 . 4 Consider the sum of k matrices of the same 
dimension, + A£ + . . . + A^ , then 



r ( 



k 

I 

i=l 



V 



k 

< l r(A.) . 

" i=l x 



B. QUADRATIC FORMS 

If A is an nxn matrix and x = (x^,...,x ) is an nxl vec- 
th 

tor with i 1 ” element x. then 

l 



3 

The symbol 
for 1 , if i= j ; 0 



6 . . is called the Kronecker delta and stands 
ID 

, if i^j. 
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n n 

Q (x) = x'Ax = T y a. .x.x. 

" “ i=l j = l ^ 1 3 



is called a quadratic form in x. The quadratic form x'Ax and 
its matrix A are called positive definite if whenever x ^ 0 , 
x'Ax > 0 ; positive semi-definite whenever x'Ax _> 0 for all 
x / 0 and x'Ax - 0 for some x j- 0 ; and non-negative whenever 
x'Ax (or A) is either positive definite or positive semi- 
definite. (Any non-negative matrix A of a quadratic form 
x'Ax is assumed symmetric for mathematical convenience and 
does not alter the value of x'Ax since 

n n n n (a. .+a . . ) 

x'Ax = y y a . . x . x . = y y x.x. 

• - di di ^ 1 3 i‘i di 2 1 : 



(A+A' ) 



X 



where 

equals 



A+A' 

2 

the 



is symmetric.) 
rank of A. 



The rank of a quadratic form x'Ax 
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III. RANK OF QUADRATIC FORMS 



This chapter (1) defines linearly independent linear 
forms and linearly independent linear restrictions on linear 
forms and (2) develops the theory of rank determination of 
quadratic forms. 

A. LINEAR FORMS 

Let X 0 be an nxl vector. If x = (x^,...,x ) is in 

E , then the linear combination 
n 

n 

L(x) = A ' x = 7 A.x. 

i=l 

of components of x with coefficients from X is called a 
linear form with the associated vector X. Since X'x is a 
scalar, X'x = x'A. The square of a linear form is a quad- 
ratic form since 

L 2 (x) = (X'x) (X'x) = (x'X) (X'x) = x' ( XX ' ) x. 

2 

Here, XX' is nxn symmetric. The rank of L (x) = r(x'XX'x) 

= r(XX') = r(X) = 1 by Theorem 2.1 since X ^ 0. So in gen- 

2 

eral, XX' is not positive definite. However, since L (x) = 

2 2 

(X'x) , L (x) is always non-negative. 

If L q ' L 2 ' ' * ‘ ,L k are linear forms in E^, they are said to 
be linearly independent if their associated vectors 
-l / -2 , ‘** / -k are li near ly independent vectors in E^, i.e., 
the rank of the matrix A = (X^ ,^2 , . . . ,X^) equals k. 

Theorem 3.1 Q(x) is a non-negative quadratic form in E n 
of rank k if and only if there exists linearly independent 



12 



linear forms ' L 2 ' * * ’ ,L k suc * 1 t ^ iat 

k 2 

Q (x) = \ L. (x) for every xsE . 

i=l 1 n 

Proof: Suppose Q (x) = x'Ax is non-negative with rank k 

and associated matrix A. By Theorem 2.2, there exists a 

non-singular matrix C such that C'AC = / d^e{0,l}, 

i=l,...,n. Define L.:E ->E n by L.(x) = c ! x where c! is the 
' 1 n 1 1 l - -l- -l 

th ^ 

i row of C , i=l,...,k. Then, is a linear form and 
letting z = (L^ (x) , . . . ,L (x) ) = (c^x , . . . ,c^x) , it follows 
that z = C X x or x = Cz. In that case, 

n 2 n 2 

x'Ax = z ' C ' ACz = z (d. 6 . . ) z = T d.z. = ) d.L.(x). 

J i=l i=l 



But, by Theorem 2.2, k is precisely the number of non-zero 
d^ ' s . Deleting those d^ such that d^ = 0 and renumbering 
subscripts, if necessary, yields 



Q (x) 



x ' Ax 




Since C ^ is non-singular, the vectors c£,...,c£ are linearlv 
independent and so then are the linear forms by definition. 

Conversely, suppose L^,...,L^ are linearly independent 
linear forms. Then, by definition, there exists k linearly 
independent non-zero vectors X^,...,X^ where X^ is asso- 
ciated with , i=l,...,k, that is, 

n 



L i <*) 



j = l 



X . . x . 
ID 1 
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for every x = (x^ / ...,x n ) in E n . Letting X ^ 
the matrix 



(X il' 



. ,X. ) , 
-in 



A = 



1— 1 
1 — 1 

r<\ 


-21 * 


* * -kl 


-12 


-22 * 


• • * k2 



-In -2n 



X, 

-kn 



nxk 



necessarily has rank k because the rows are linearly inde- 
pendent, i.e., r(A) = k. 

Consider 



Q (x) = l L7(x) 
i=l 1 " 



Now 



hence 



L i (x) = L i (x)L i (x) = ' (X|x) = x* (X.X[)x 



k 

l 

i=l 



k 

= x* I 

i=l 





k 




X ! ) x = 

-l - 


( l 


X . X ! ) x 

-l-i - 


i=l 


2 

il 


A il X i2 


i — 1 

• 

• 

• 


i2 X il 


x 2 7 

i2 


• • • X « 

2.2 

• • 


in X il 


X. X.„ 
in i2 


x 2 

m 



X 



nxn 
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Q (x) = x' 



y at, y a.,a. 0 ... y a ... a 

. L , ll . L 1 ll i2 . L , ll 

1=1 1=1 1=1 



in 



k k 

£ X i2 X il X X i2 

i=l i=l 



k 

y a . 0 a . 

. L , i2 in 
i=l 



x 



y a. a., y a . a . 0 . . . y a 2 

. L , in ll .k m i2 • “ , l 



i=l 



i=l 



i=l 



in 



nxn 



x 1 Ax whe re A = J A . A ! . 

- i£i 



Notice that A is symmetric. Thus, Q(x) is a quadratic form 
in x and it must follow that the rank of 0(x) equals r(A) . 
Observing that A is, in fact, the product of A and A', 

A = AA’ , 

and, applying Theorem 2.1, r(A) = r(AA') = r(A) = k. Con- 

2 

sequently, r(Q(x)) = r(A) = k, and since L^(x) is non- 
negative so also then is 



l L 2 (x) = Q (x) . Q.E.D. 
i=l 1 

B. LINEAR RESTRICTIONS 

A vector a = (a^,...,a^) in E^ is called a linear restric- 
tion on the set of linear forms, {L^,...,L^} if a / 0 and 

k 

a 'L (x) = y a . L . (x) = 0 

iii 1 1 ‘ 

for every xeE n where L(x) = (L^,...,L k ). 
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As will be seen, a linear restriction has the effect of 
reducing the rank of a quadratic form by one. Another linear 
restriction will further reduce the rank, only if it and the 
first are linearly independent. In general, it is important 
to find the total number of linearly independent linear 
restrictions on a given set of linear forms, {L^,...,L^}, in 
order to determine the rank of the quadratic form, 

k 

Q (x) = l L. (x) . 
i=l 1 

Theorem 3.2 If there are exactly m linearly independent 
linear restrictions on the linear forms, L^,...,L^, (m<k) 

then the rank of 

k 2 

Q(x) = l L . (x) xeE 
i=l 



is k-m. 

Proof : Suppose a^,...,a are linearly independent linear 

restrictions on the linear forms, L^,...,L^, where = 



(a 



il 



,a ik^ f° r eack i=l ,...,m. 



Then 



JS. JS. 

y a . .L . (x) = T a . . X '.x = 0 

j = l ^ " j = l 1 3-3" 



for all x in E , i=l,...,m, where X. is associated with the 
n' ' ' ' -j 

linear form L_. (x) for each j = l,...,k. Recall that 



Q (x) = £ LT (x) = x'(AA')x 

i=l 1 
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where 



A' = 



X 11 • 


r v 
1 — \ 

<< 

• 

• 




V 


• # 


m 




• 


• 


• • 




• 


• 


• • 




• 


_ X kl * 


* * X kn_ 




1 

<<\ 

i 



Let A = 



w i 




k 


a! 


then AA'x = 


7 a, . X .x 


-1 

• 

# 

• 




j=i 

• 

# 

k 


a 1 




T a . X .x 


-m 




j = l 



= 0 



for all x in E n . Hence AA ' = 0. r(A) = m by hypothesis, 
and by Theorem 2.3, r(A') <_ k-m. 

Suppose m is the maximum number of linearly independent 
linear restrictions on the linear forms, L^,...,L^, and 
r(A') < k-m. Since r(A) = m, there exists an mxm sub-matrix 

A* of A such that |a*| f 0. Without loss of generality, let 



11 lm 



A* = 



ml mm 



Since r(A') < k-m, the last k-m rows of A', X' , , . . . , X£ , 
among others, are linearly dependent. Then there exist 
scalars b lf ...,b^, not all zero (say b^O) , such that 



b T X' , + 
1 -m+1 



. + b k X' = 0. 
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Let 3 = ( 0 , . . . , 0 ,b m+ ^ , . . . ,b^) . Then certainly, 
k k k 

l £,L. (x) = l b. X ! x = ( l b. A!)x = Ox = 0 
i=l 1 1 m+1 1 1 m+1 

so that a^,...,a , 3 are linearly independent. For suppose 



Then 



c. a, + . . . c a = c , . 3 = 0 . 
l-l m -m m+1- - 



c i a n + 



. + c a . 
m ml 



= 0 



c. a. 

1 lm 



+ • • • + c cx 

m mm 



= 0 



c.a. ,,+...+ c a ,, + c ,.3 , n = 0 
1 l,m+l m m,m+l m+1 m+1 



c l a lk 



. + c a , 
m mk 



+ c , , 3, 
m+1 k 



= 0 



(c^,...,c m ), the first m equations can be 



or letting c 

written A* c = 0. Since A* is non-singular, c = 0, that 



is, c 1 = 



= c^ = 0, and the last k-m equations become 
C m+l 3 m+l = 0 



C m+l 6 k 



= 0. 



But 3 k 7 ^ o , hence c m+ ^ = 0. Consequently, a^,...,a m ,3 are 
linearly independent contradicting the maximality of m. 
Hence r(A') = k-m and since r(A') = r(AA') by Theorem 2.1 
r(Q(x)) = k-m. Q.E.D. 
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Corollary 3.3 If there is at least m linearly independ- 



ent linear restrictions on the linear forms, (m<k) 

then the rank of 

k „ 

Q(x) = l L. (x) 
i=l 1 



for all x in E is less than or equal to k-m. 
_ n a 



Theorem 



3 . 4 The linear forms are linearly 



independent if and only if there are no linear restrictions 
on , • • • ,Lj^ • 

Proof ; Suppose . ,L^ are linearly independent and 

there exists at least one linear restriction, a = (a^,...,^) 
on L^,...,L^ such that + . . . + = 0. Hence, one 

of the linear forms, say , can be written as a linear com- 
bination of the remaining k-1 linear forms 



a 2 


a k T 


~~ — “ • 


. . L 


2 


a l 


&2 L 2 + • • 


* + B k L k 



a . 



where 6 . = 
3 



— *i — O 

, J , 



a 



Consider the vectors, X^,...,^*, associated with the 
linear forms , L^,...,L^, and the matrix formed by these 
vectors , 



" X ll * 


. . X i 
In 




V 


• • 


• 




# 


# 


• • 




• 


• 


• • 




• 


• 

I - 1 


. . X, 

kn 




A 
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where by hypothesis, r(A') = k. Now 
L 1 = ® 2 - 2 - + • • • + 



(.1 B.X )x + 
i=2 1 11 A 



. + ( y 3 • X . ) x 

1=2 1 in n 



which implies 



h 



i=2 



3. A. . 

l ll 



k^— 



k 

1, 6 i x i 

where 3 = ( 32 > • • • / 6^) * Hence, is a linear combination of 
the remaining k-1 rows of A', i.e., r(A') _< k-1 which contra- 
dicts the linear independence of the linear forms L^,...,L^. 

Therefore, there are no linear restrictions on L, , . . . ,L. . 

I k 

Conversely, suppose there are no linear restrictions on 
the linear forms, L^,...,L^. Letting m = 0 in Theorem 3.2, 
the rank of 

k „ 

Q(x) = l Lf(x) 
i=l 1 

2 

for all x in E n equals k-m = k. Since L^(x) is non-negative, 
so then is Q(x). Upon applying Theorem 3.1 the linear forms, 
L^,...,L^, are seen to be linear independent. Q.E.D. 
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IV. APPLICATIONS TO ANALYSIS OF VARIANCE 



Knowledge of the rank of a quadratic form is essential 
in testing for the equality of means of k normal oooulations 
having the same variance. This statistical method is called 
the analysis of variance. This chapter demonstrates the use 
of linearly independent linear restrictions of linear forms 
to determine the rank of quadratic forms. 



A. ONE-WAY CLASSIFICATION 

Suppose that there exists k groups of independent obser- 
vations 



Y 11 ' * * ’ ,y ln 1 ,y 21' * * ' ,y 2n 2 '* * * 



' v k! ' * * * ' y kn. 



from normally distributed populations with means y^,...,y^ 

2 

all with the same variance o . Thus the model is 
y . . = y . + e . . i=l , . . . ,k i-1 . . . . ,n . 

where y^ are fixed constants and the . are independent 

2 

random normal deviates with zero mean and variance c . 

Let x. . = — (y. . -y.) Consider the identity 
1 D 0 1 3 i 



x. . = (x , -x , ) + (x,-x) + x 
ID iD i i 



( 1 ) 



where 



n . 

- 1 V • -I 

x i = n. 1, x ij 

i 3 = 1 J 



,k 



i K 

= - l 



X - . 

n i=l 1 



Squaring both sides of equation (1) and summing over i and j. 



i=l,.„.,k, j=l,...,n i yields the identity 

k 



i n • 

k 1 



i n • 

k i 



y y x z . = y i u. .-x .) 2 + i n 
i=l j=l ^ nil jil ^ 1 i=l 



- . 2 , - 
k (x i -x) + nx 



Q = Ql + Q 2 + Q 3 - 

2 

Since y. . is N(u. ,c ) then x. . is N(0,1) and 

i n • 

k i 



Q = 1 l 



is x ( n ) and has rank 



i=l j=l 



n = y n. , 
i=l 1 



The ranks of , Q 2 , and Q^, in turn, can be found by find- 
ing the number of linearly independent linear restrictions 
associated with each quadratic form and applying Corollary 
3 . 3 and Theorem 2.4. 

Consider first 

k n ‘ 

o <x) = i \ (x > 2 . 

1=1 j=l J 



where x - <* u x^ ~ K1 ^ - 1} 



. ,x kl , . . . ,x kn ). Let L i . (x) = 



(x. .-x.) = X! .x be a linear form in x where X. . is an nxl 

13 1 -13- - -13 



vector 



n . 

1 



i=l 

J n rows 
L i u 

U=1 
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1 

n 



X. . = 
-ID 



1 - i 



1 

n 



n . 

l 



i=l . h 

( l n u +j) row 

U=1 



i=l 



( 7 n ) 

u 

U=1 



th 



row 



i=l 

n- ( y n ) rows 
T u 
u=l 



nxl 



_J 



For each i=l.,,,.k there exists an nxl vector such that 



n . 

i 



a !L (x) = y a . .L . . (x) 
-i- - 13 i] - 



j=l 

n , 



y (x. .-x.) = 

j£i ^ 1 



= 0 



where 



-1 



0_ 

1 



1 

'0‘ 




n rows 
u 



i=l ^ 

( l n u ) th row 

u=l 



nxl 
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and 



X 11 X 1 



L (x) = 




x kl x k 



x, -x, 
kn k k 



nxl 



Forming the matrix A = (a^,...,^) 



A = 




n^ rows 



n 2 rows 



n k rows 
nxk 



it can be seen that the columns of A are linearly independent 

i.e., r(A) = k; hence by definition, the set of k vectors 

are linearly independent linear restrictions on 

the linear forms, L^,...,L^ n ' • • • ' L ki / • ♦ ♦ ' L kn. * Applying 

1 k 



Corollary 3.3, r(Q^) _< n-k, 
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In a similar manner for 



-2 

Q 9 (x) = l n . (x . -x) 
z i=l 1 1 



where x = (x^,...,x^) let 



L i (x) = /nT (x i -x) (i=l,...,k) 



= A ! x 

-l- 



be a linear form in x where A . is a kxl vector 

-l 



/nT (- ±r) 
l k 



A. = 

-l 



(- i, 



/ nT ( 1 - r ) 
l k 



/n7 (- i) 

l k 



/nT (- ±) 
l k 



. th 

i row 



kxl 



Likewise, there exists one kxl vector a such that 



a'L(x) = l a . L . (x) 
i=l 1 1 " 



= £ a . { /n7 (x . -x) } 

i=l 1 1 1 



= I /nT ( x . -x) 

i=l 1 1 



= 0 
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where 



a = 


i 

• 


and L(x) = 


/rT^x^x) 

• 

• 




# 

i 


kxl 


# 

v^U k -5) 



Here a represents at least one linear restriction on the 
linear forms, (x) , . . . ,L^ (x) , and by Corollary 3.3 
r(Q 2 ) — k~l* 

- -2 

Lastly, Q 3 (x) = nx is the square of a single linear 
form, L(x) = /nx, and has rank, r(Q 3 ) = 1. 

In summary, 

r(Q) = n 
r (Q 1 ) <_ n-k 

r(Q 2 ) < k-1 

r(Q 3 ) = 1 

where Q = + Q 2 + Q^. Hence 

r(Q^) + r(Q 2 ) + r (Q 3 ) £n-k + k- l + l = n 
but by Theorem 2 . 4 

r (Q) = n _< r(Q 1 ) + r(Q 2 ) + r(Q 3 ). 

Consequently , 

r(Q 1 ) + r (Q 2 ) + r(Q 3 ) = r(Q) 

and 

rfC^) = n-k 
r (Q 2 ) = k-1 
r(Q 3 ) = 1 

From Cochran's Theorem the quadratic forms 0^, Q 2 , and Q 3 

2 

are linearly independent and are x distributed with n-k, 
k-1, and 1 degrees of freedom, respectively. 
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The foregoing procedure for finding at least a lower 
bound for the rank of a quadratic form 

k - 

Q(x) = I LT (x) 

i-1 1 " 

endeavors to construct a matrix of known linear restrictions, 

A 

whose rank is necessarily the number of linearly independent 
linear restrictions on the linear forms L^,...,L^. It could 
be shown that if the linear forms L^,...,L^ are linearly 
independent then Theorem 3.1 can be applied to give the rank 
exactly. Such a procedure entails finding the rank of the 
matrix of coefficient vectors, A = [X^,...,X^] associated 
with the linear forms L^,...,L^. In general, the determina- 
tion of the rank of A is complicated by the odd construction 
of the X.'s. On the other hand the matrix of the known lin- 

-l 

ear restrictions. A, contains only elements equal to zeros 
or ones. Hence, the easier method of finding information 
concerning the rank of a quadratic form is to look for the 
linear restrictions and apply Theorem 2.2 or Corollary 3.3. 

In the next section two-way classification of analysis 
of variance is investigated and it will be seen that although 
the matrix of known linear restrictions becomes larger deter- 
mining its rank remains relatively easy. 
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B. TWO-CLASSIFICATION 



In the one-way classification of the analysis of variance 
k groups of independent normally distributed observations are 
recorded. The k groups represent k different variations of a 
particular variable or factor which is needed to yield a de- 
sired result, e.g., the observation itself. It is the purpose 
of the analysis of variance to ascertain if there is any sig- 
nificant differences in the results of any of these variations. 
The measurement of crop yield using different types of ferti- 
lizer is an example of such a grouping or classification. 

In a two-way classification of the analysis of variance 
the results of an experiment are classified according to var- 
iations of two influencing variables. In the crop growth ex- 
ample, crop yield can be classified, not only by different 
types of fertilizer, but also by various soil compositions. 

Suppose there exists r variations of one classification 
and c variations of a second classification. Consider n 
observations taken from each of rc possible combinations of 
the two classifications. In tabular form 



* Xic 

• • 

' *rc 
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where 



y = (y ....... ,y . . ) is an nxl vector. It is assumed 

x -^ljl 2 1 jn 

that the rc sets of n observations are random samples from 



rc separate populations, each normally distributed about 

. 2 

mean u . . but all with the same variance a . The model is 
il 

y . . = y . . + e . . i=l , . . . ,r 

^lDV ijv . ' ' 

J “ ^ / * • • / 
v=l , . . . ,n 

2 

where e . . is N( 0 .o ) . Let 
13 V 



y. . -y . 

x _ ^i]V i-P 
ijv a 



and consider the identity 



x. . = (x. . -x. .) + (x. ,-x. -x . +x ) + (x. -x) 

ijv ijv 13 lj l • *3 i* 



(2) 



+ (x .-x) + X 

* D 



where 

x 



l n 

ID n v £ x i D 



v 



c n 



x 



1 n— n -i 

. = L_ y y x . . = i y x. . 

i* cn i]v c i] 

j=l v=l J - , = 1 J 



r n 



c 

\ 

j = l 

r 



1 J- li n -L 

x . = i— y y x. . = i y 

• 1 rn L n iiv r . L 



x . 



-j rn iiv r . % 11 

J i=l v=l J i=l J 



x 



1 

rcn 



I 



i=l 




n 



I 

V=1 



X . . 



13 V 





Squaring both sides of equation ( 2 ) and summing over i, 3 
v, i=l,...,r, j=l,...,c, v=l,...,n yields the identity 



and 
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r c n 



r c n 



l l l X iiv = l l l (x iiv _x ii )2 
i=l j=l v=l 1]V i=l j=l v=l 1JV 13 



r c 



2 

n I I (x in" x i.' x -n +x) + nC l 

i=l i=l 13 1 3 i=l 



-v 2 

(xi.-x) 



+ nr 



l <5 .-Jr + 

j-1 3 



- v 2 . -2 
rcnx 



Q = Q x + Q 2 + Q 3 + Q 4 + Q 5 

2 



The rank of Q is rcn since it is x with rcn degrees of 
freedom. The ranks of , . . . ,Qj- can be determined by finding 
the number of linearly independent linear restrictions asso- 
ciated with each quadratic form and applying Corollary 3.3 
and Theorem 2.4. 

Following the procedure of the previous section consider 
first 



rcn 



Ql (x) = l l l (x ijv" x ii 
i=l j=l v=l 1DV 3 



where 



x = 



-11 



X m 

-lc 



X 1 

-rl 



x 

L -rc J 



X. .. 

13! 



with x . . 

-13 



rcnxl 



x . . 
1 3 n 



x . . 
1 3 n 



i=l / 
j = 1 / 



. . ,r 

• • f c 



nxl 



nxl 
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Let L. . (x) = (x. . -x . . ) i=l,...,r be a linear form in x 

i;jv - 13V 13 ' 

J “-**/• • • f ^ 

v=l , . . . ,n 



= X! . x 
-13V- 



where X . . is a rcnxl vector 
-13V 



X . . 
-13V 



1 

n 



1 

n 

1 - i 

n 

1 

n 



1 

n 



{(i-l)c+j}n rows 



{ (i-1) c+j }n+v row 



rcn-{ (i-1) c+j+l}n rows 



rcnxl 



For each i, j, i=l,...,r, j=l,...,c there exists an rcnxl 



vector a. , such that 
ID 



n 



a ! .L (x) = T a . . L . . (x) 

-ID " ^ iDV ID v - 



= y (x . . -x . . ) 

L , 13V 13 



n 

l 

v=l 
= 0 
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where 



and L(x) ■ 
Note that 

using the 



A becomes 



(i-l)c+j n rows 



X . . = 
-ID 



. 0 . 

1 

# 

1_ 

0 



rcn- ( i-1) c+ j+1 n rows 



rcnxl 



: (L^j v (x) ) / • • • / j— l/***/^/ V s 1 , . . . , n . 

there are rc such vectors, Forming the matrix 

*i < » # « * x i # • * * # / 

-11' '-rl' -lc' -rc 



nxl sub-matrices 



"• *■ 




“ — 


1 




0 


# 




# 


• 


and 0 = 


• 


# 




» 


1 


nxl 


0 

- — 



nxl 
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A = 



i o 
o 1 



0 0 



goo 

ooo 



10 0 



g g 

o o 



g g g 

ooo 



g 

o 



g g 

o o 



o o 



g 

o 



g 

o 



l g 

o 1 



00 ... 000 ... 0 ... 00...1 



rcnxrc 



It can be seen that the columns of A are linearly independent, 
i.e., r(A) = rc; hence by definition, the set of rc vectors, 
(oUj ; i=l,...,r, j=l,...,c} are linearly independent linear 
restrictions on the linear forms {L^ v (x) ; i=l,...,r, 
j=l,...,c, v=l,...,n}. Applying Corollary 3.3, 
r(Q^) <_ rcn-rc = rc(n-l). 

In a similar manner for 

r c 



_ __ _ _ _ ^ 

Q 2 (x) = n ^ ^ (Xij-Xi.-x.j+x) 



i=l j=l 



where x = (x.. . , . . . ,x. , . . . ,x . , . . . ,x ) let 

11 lc' ' rl ' ' rc 

L . . (x) = (x..-x. -x . +x) i=l,...,r 

13 " 13 1' *3 i-i ' 

= X! .x 
”13“ 



be a linear form in x where X . . is a rcxl vector 

-13 
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rc 



_i 

rc 

i + -A 

r rc 
_1 
rc 



.th 

D 



row 



_1 

rc 




, . -| v th 

(i-l)c row 




z . i \ , . th 

(i-l)c+3 row 




_1 

rc 



. th 



1C 



row 



_1 

rc 

I + -i 

r rc 

JL 

rc 

« 



_i 

rc 
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_1 

rc 



_1 

rc 

1 + -± 

- + rc 

_1 

rc 



(r-1) c+j th 



row 



# 

_1 

rc 



rcxl . 



Likewise there exist r+c vectors {a.;i=l,.... 



-l 



{$j,* j=l,...,c} such that 



and 



a !L (x) = T a . .L . . (x) 
-l- - 13 13 - 



j=l 



= y (x. .-x. -x . +x ) 

• T 13 1 * • 1 



j-1 1D 
= 0 



§-L(x) = l 3 i -L (x) 
3 i=l 13 13 



= y (x . . -x . -x .+x) 
1^1 1-3 1 * *3 



= 0 



r) and 
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where 



a 



1 




c rows 



c rows 



i*"* 1 block 
of c rows 



c rows 



f c rows 
rcxl 



c rows 



-3 



c rows 





row 



i th block of 
c rows 

th 

ic+j row 



(r-1) c+j th 



rcxl 



respectively . 



row 
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Forming the matrix 



A = 






' - r ' -1 ' 



•'*c ] 



1 0 
0 1 
0 1 



0 1 . 



0 0 
0 0 



0 10 
0 0 1 



0 0 0 
0 10 
0 0 1 



0 0 0 . 



110 
10 1 



00 ... 100 ... 1 



0 

0 



1 

0 

0 



0 

0 



rex (r+c) 



it can be seen that 



l “i = I / 

i=l 1 j=l 3 

hence the rank of A is at most r+c-1. Consider the (r+c-1) 
x(r+c-l) sub-matrix of A, 



A* = 



10 0 
10 0 



10 0 
10 0 
0 10 
0 0 1 



0 0 0 
0 0 0 



0 0 10 0 
0 0 0 1 0 



0 0 0 0 0 
0 0 0 0 0 
0 0 10 0 
0 0 0 1 0 



1 0 0 0 0 
0 10 0 0 



0 

1 



c rows 



r-1 rows 
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Now | A* | = + 1 depending if r+c-1 is odd or even. Consequent- 
ly, r (A) = r+c-1 and by definition, the set of vector 
{a^,...,a , $^,...,§ c } represent r+c-1 linearly independent 
linear restrictions on the linear forms (x) ; i=l,...,r, 

j=l,...,c} and by Corollary 3.3, ^ rcn-r-c+1 = 

(r-1) (c-1) . 



Consider next 



-x 2 



Qo (x. ) = nc l (x. ,-x) 
i=l 1 



where x. = (x. ,...,x ). Let 

1 ♦ r • 



L i# (x.) = (x i# -x) i=l , . . . , r 



= X! x. 

-l • - 



be a linear form in x. where X. is a rxl vector 

-l . 

1 
r 



1 

r 

1 - i 

r 



1 

r 



1 

r 



. th 

-l row 



rxl 



There exists only one vector a such that 

r 

a 'L (x. ) = I a.L. (x. ) 

- “ - . L n 1 1 # “ 

1=1 



= X (Xi.-5) 

i=l 1 
= 0 
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where 



a = 



1 



1 



rxl . 



Hence a represents one linear restriction on the linear forms 

{L. (x.); i=l,...,r} and by Corollary 3.3, r(O^) < r-1 . 

By an analogous argument r(O^) <_ c-1. 

- -2 

Lastly, Q,-(x) = rcnx is the square of the single linear 
form, L(x) = /rcn x, and has rank, r(Q 5 ) = 1. 

In summary. 



r (Q) 


= 


rcn 


r(Q x ) 


< 


rcn-rc 


r(Q 2 ) 


< 


rc-r-c+1 


r (Q 3 ) 


< 


r-1 


r(Q 4 ) 


< 


c-1 


r(Q 5 ) 


= 


1 



where 

Q = t Q 3 Q3 Q5 • 

Hence , 

5 

T Q, < rcn-rc+rc-r-c+l+c-l+r-l+l 
k=l * “ 



rcn 



but by Theorem 2.4 

r(Q) 



5 

rcn < l r (Q v ) . 
k=l 



Consequently , 

r(Q 1 ) + r(Q 2 ) + r(Q 3 ) + r(Q 4 ) + r(Q 5 ) = r(Q) 
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and 



r(Q 1 ) = rc(n-l) 
r(Q 2 ) = (r-1) (c-1) 
r(Q 3 ) = r-1 
r(Q 4 ) = c-1 
r(Q 5 ) = 1. 

From Cochran's Theorem the quadratic forms 

2 

are linearly independent and are x distributed with degrees 
of freedom equal to their respective ranks. 
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V. CONCLUSION 



In general it may be difficult to verify that the linear 
forms (x) , . . . ,L^ (x) are linearly independent directly, or 
when they are not, to find the maximum number of linearly 
independent linear restrictions on them in order to determine 
the rank of the associated quadratic form 

k 

Q (x) = l L. (x) . 
i=l 1 

Fortunately, it is sufficient only to observe that if there 
are at least m linearly independent linear restrictions, 
then the rank must be less than or equal to k-m. Enough 
information is often then available to establish that no 
more linear restrictions exist. Hence, indirectly, the rank 
is found to be exactly k-m. The application of rank deter- 
mination to analysis of variance is an example of this in- 
direct procedure. 

It may now be stated that the procedure as outlined by 
Cramer [1] and Hald [2] for determining the rank of quad- 
ratic forms has been explicitly justified in detail and 
illustrated. 
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